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Abstract 

We obtain a generalization of Noether's invariance principle for opti- 
mal control problems with equality and inequality state-input constraints. 
The result relates the invariance properties of the problems with the 
existence of conserved quantities along the constrained Pontryagin ex- 
tremals. A result of this kind was posed as an open question by Vladimir 
Tikhomirov, in 1986. 
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1 Introduction 

Noether's invariance principle is one of the most helpful and fundamental results 
of physics. It describes the universal fact that "invariance with respect to some 
family of parameter transformations gives rise to the existence of certain con- 
served quantities." Such relation is used to explain everything from the fusion 
of hydrogen to the motion of planets orbiting the sun . For a modern account 
of Noether's invariance principle, in the context of the calculus of variations, 
we refer the reader to ^ . Extensions for the unconstrained problems of 
optimal control are available in [SJ E]- Here we generalize the previous results 
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[HI IS] to cover both holonomic and nonholonomic constraints. The motivation 
for the present study was Tikhomirov's book 7J Sec. 4.3]: Presumably, it can be 
shown for a sufficiently broad class of extremal problems involving constraints 
that Noether's invariance theorem is still valid. But general results of this kind 
have, to date, not been obtained. Theorem 13. II provides such general result. 

2 Constrained Optimal Control Problems and 
Optimality Conditions 

We deal with a broad class of extremal problems in the calculus of variations and 
optimal control involving equality and/or inequality constraints. We consider a 
nonlinear control system, 

x{t) = V (t,x(t),u{t)) , (1) 
of n differential equations, subject to m — m! equality constraints, 

(pi (t,x(t),u(t)) = 0, i = l,...,m-m' , (2) 
m' inequality constraints, 

<t>j (t, x(t), u(t)) > , j = m — mf + 1, . . . , m , (3) 
and 2n boundary conditions 

x(a) = a , x(b) = j3 . (4) 

The problem is to find a piecewise-continuous control function u(-) = (ui(-), . . . ,u r (-)), 
and the corresponding state trajectory x(-) — (xi(-), . . . , x n (-)), satisfying Q), 
J21 , © , and (0| , which minimizes or maximizes the integral cost functional 

I[x(-),u(-)} = ( L{t,x{t),u(t))dt. 

J a 

This problem is denoted in the sequel by (P). Both the initial time a and termi- 
nal time b, a < b, are fixed. The boundary values a, j3 € R™ are also given. The 
functions L(-, •, •), ip(-, •, •) and </>(•, •, •) are assumed to be continuously differen- 
tiable with respect to all variables. We shall also assume that the Jacobian of the 
constraints Q and x, u), has full rank for all (t, x, u) e [a, b] x R" x W 

4, Ch. 6]. Many practical applications of problem (P) appear in engineering 
and economics. We refer the interested reader to [2] and references therein. 

The celebrated Pontryagin's maximum principle 0] gives necessary optimal- 
ity conditions to be satisfied by the solutions of optimal control problems. 

Theorem 2.1 (Pontryagin Maximum Principle for (P)). Let u(t), t € 
[a, b], be an optimal control for the constrained optimal control problem (P), and 
x(-) the corresponding state trajectory. Then there exists a constant ipo < 0, a 
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continuous costate n-vector function ?/>(•) having piecewise- continuous deriva- 
tives, and (assuming that the rank condition is satisfied) piecewise- continuous 
multipliers A(-), A(t) > 0, satisfying the equations: 

3H 

x{t) = -g- (i, x(t), u(t), ^o, VW. *(*)) , 

= — T^T (*, u(t), vo, A(t)) , 

— (t,x(t),u(t),ip ,tl>{t),\(t)) = 0, 
aw 

along with the constraints ©-© a7tc ^ boundary conditions (0J 7 where the Hamil- 
tonian H is defined by 

H(t, x, u, ipoi i>i A) = ipoLit, x, u) + ifi ■ ip(t, x, u) + A • </>(i, x, u) . 

Moreover, H (t, x(t), u(t), ipo, ip(t), X(t)) is a continuous function oft and, on 
each interval of continuity ofu(-), is differentiable and satisfies the equality 

dH _ 8H 

~d7~~dt- (5) 

For versions of Theorem 12.11 under weaker smoothness hypotheses on the 
data of the problem, see E] ■ 

3 Main Result 

The following result asserts that the presence of an invariant structure of the 
optimal control problems involving equality and inequality constraints, imply 
that their extremals (and solutions) also possess a certain invariance. The result 
is expressed, as it happens for the problems of the calculus of variations ^] 
and for the unconstrained optimal control problems [El El , as an instance of 
Noether's universal principle. Theorem 13.11 extends Theorem 5.1] to the case 
of constrained optimal control problems. 

Theorem 3.1. If there exists a C 2 -smooth one-parameter family of maps 

h s : [a, t] x 1" x f ^ 1 x R" x K r , 
h s (t, x, u) — (T(t, x,u,s),X(t,x,u,s),U (t, x, u,s)) , 
s e (— e, e) , e > , 

with h (t, x, u) — (t, x, u) for all (t, x, u) G [a, b] x K™ x W~ , and satisfying 

L (t, x(i),u(t)) = L o h s (t, x(t), u(t)) ^-T it, x(t),u(t), s) , (6) 

dt 

^-X (t, x{t), u(t),s) =<poh s (t, x(t),u(t)) 1-T (t, x{t), u(t),s) , (7) 
dt dt 

<\> (t, x(t),u{t)) =<t>oh s (t, x{t),u(t)) —T (t, x{t), u{t),s) , (8) 
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then, 

^(t)-— X (t, u(t), s)| s=0 -ir(t, u(t),ip , 1>(t), A(i)) — T (f, a;(t), «(*),«) 

is constant in t £ [a, 6] /or ani/ quintuple (x(-), u(-), tpo, V'(')) A( - )) satisfying 
the Pontryagin maximum principle (Theorem \2.1\) . with H the Hamiltonian 
associated to the problem (P): 7? (i, x, u, V'o, ^, A) = ipoL(t, x,u) + ip- ip(t, x, u) + 
A • 0(i, x, u). 

Proof. Using the fact that h°(t, x, u) — (t, x, u), from condition © one gets 

d 
ds 



= — [Loh s (t, x(t), u(t)) — T (t, ^(t), u(t), s) 



s=0 



9L 


9T 




9L 


dX 




9£ 


dU 


9* 


9s 


s=0 


dx 


ds 


H 

s=0 


du 


ds 



s=0 



d_ dT 

dt ds 



(9) 



s=0 



while condition Q and JSJl yields 



d dX 
dt ds 

= 



dtp dT 
~dt 9s~ 



dip dX_ 
dx ds 



dip dU 
du ds 



d dT 
dt ds 



dcj) dT 
~dt 9s~ 



dj>_ dX_ 

dx ds 



90 dU 
du ds 



d dT 
dt ds 



(10) 
(11) 



Multiplying @ by ipo, tUJ by tp(t), and {II} by A(t), we can write 
dL dX 



+m 

+ X(t) 



dL dT 
~dt 9s~ 

dp dT 

~bl 97 



+ 



s=0 



s=0 

90 9T 
dt ds 



s=0 



dx ds 
dp dX_ 
dx ds 
^90 dX_ 
dx ds 



dL dU 

dp_ dU 
du ds 
90 dU 
s =o 5u 5s 



s=0 



s=0 



s=0 



L— — 

dt ds 

d dT 



s=0 



dt ds 

0— — 

dt ds 



s=0 



d_ dX_ 

dt ds 



s=0 



= 0. 



(12) 



According to the Pontryagin maximum principle, the function 

ip Q L (t, x(t), U (t, x(t),u(t), s)) + ip{t) ■ p (t, x(t), U (t, x(t),u(t), s)) 

+ X(t) ■ (t, x(t), U (t, x(t), u(t),s)) 



attains an extremum for s = 0. Therefore 



and (|12fl simplifies to 



'dL dT 
~dt ~ds 



dL dX 

dx ds 



+ L 



'dtp dT 



s=0 



s=0 

dip dX_ 
dx ds 



d_ dT 

dt ds 



,'d<j> dT 



From the adjoint system ip 



s=0 



s=0 

d(j) dX 
dx ds 



s=0 

d_ dT 
dt ds 



s=0 



d dX 

8=0 dt 93 

, _d dT 

dt ds s _. n 



= 0. (13) 



■ ^ and the equality (J5J , we know that 



tp = -ip 



dt 



dL 




— -A- 

dx 


d<f> 


dx 


dx 


dL 






dcj> 


~dt 


~dt 



and one concludes that is equivalent to 



d ( i / \ dX 



s=0 



as 



s=0 



= 0. 



The proof is complete. 



□ 



Remark 3.1. Theorem 13.11 is still valid in the situation where the boundary 
values of the state variables are not fixed. We have considered conditions (@J only 
to simplify the presentation of the maximum principle: transversality conditions 
are not relevant in the proof of our result. 

Remark 3.2. It is possible to give a formulation of Theorem 13. II under gauge- 
variance (see [5] for the concept of gauge- variance), and deal with equalities 
U P to first-order terms in the parameter s (see the quasi-invariance 
notion introduced in |U] for the unconstrained optimal control problem). 

We now illustrate the application of Theorem 13 . II with an example. 



4 Extraction of an Exhaustible Resource 

We borrow from %, pp. 194-198] a simple example of an optimal control problem 
in economics with one state variable, two control variables, and an equality 
constraint on the state and control variables [n = 1, r = 2, m = 1, m' = 0): 

T 

uj(t)dt — > max 
x(t) = -u 2 (t), (14) 



x^(t)u^(t)~uj(t)=0, 
x(0) = x , x{T) = X T , 
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where 7 < 1, a + (3 < 1 (a,(3 > 0), and xt < Xq. Here x(t) denote the stock of 
an exhaustible resource at time t] u 2 (•) the rate of extraction from the stock; and 
Ui(-) the flow of consumption of the finished good: see [2] for more details on the 
model, and for an economic interpretation of the Pontryagin maximum principle. 
Problem i|14|) is invariant under the one-parameter family of transformations 
h s (t, x, u%, u 2 ) — (T(t, s), X(x, s), Ui(u%, s), U 2 (u 2 , s)) defined by 

T(t, s) = e-^ a+p)s t , X(x,s)=e ( - 1 -^ s x, (15) 
tfi(ui, s) = e^+^m , U 2 (u 2 , s) = e (Q7+1 ^ 2 , 

which coincides, for s — 0, with the identity transformation: h°(t, x, u±, u 2 ) — 
(t, x, Mi, u 2 ). In fact, for problem (|14|l one has L(u\) = uj, <p{u 2 ) = —u 2 , and 
4>(x,ui,u 2 ) — x ai u^ — uj, and all conditions ©, J7J), and (jHJ are satisfied 
under ((i3|) : 

L(U!)jT(t, s) = e -((<*+P> u J e -y(<*+0> = u\ 
= L{ui) , 

ip{U 2 )jT{t,s) = - e (Q7+1)s u 2 e- 7(Q+/3)s = ~e^^ s u 2 = e^'^'x 
<p(X, Ux,U 2 )jT(t, s) = ( e a7(1 - /37)s x a7 e /3 ' y(Q7+1)s ^ 7 - e 7(Q+/3)s u 7 ) e ~^ a +P) s 

— e l{a+/3)s (^ X <*1 U P~< _ u J^j e ~~({a+l3)s 

= ct>(x,ui,u 2 ) ■ 

Having in mind that the problem is autonomous, that is, the Hamiltonian 

H(t, x, u\, u 2 , ipo,ij), A) = ipouj — ipu 2 + A ^x" 7 ^ 7 — ujj does not depend on t, 

and that from equality 101 this implies the Hamiltonian H to be constant along 
the extremals, it follows from our Theorem 13 . II that 

(1 - /3j)ip{t)x(t) + jH(a + (3)t = constant . (16) 

Relation IjlfiJ) gives an immediate insight about the solution of the problem - 
the rate of the value times the stock size of the resource must be constant: 
^ (ip(t)x(t)) — const. This conservation law has an economical interpretation 
in terms of the Cobb-Douglas form of the production function. 
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